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(57) Abstract 

Described is a method for controlling prostheses and other assistive devices using tissue whose state is influenced by the central 
nervous system of a user. The state of the tissue is sensed, and information from this sensing is fed into a unit (9, 10) that estimates 
the motor intention of the user and controls the prosthesis according to this estimate. The method comprises transmission of ultrasound 
signals into the tissue by use of an ultrasound transducer (6) and then reception of the ultrasound signals modulated by the tissue by use 
of an ultrasound transducer (7). Based on these received ultrasound signals, the motor intention of the user is estimated, and based on this 
mentioned estimate a number of prosthesis states are controlled. 
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Method for control of prostheses and other aid means 

The present invention describes a method for control of prostheses and other assistive 
devices, according to the introductory part of claim 1. 
5 The term "prosthesis" primarily refers to an artificial hand, arm, foot, leg or the like, with 
one or more motorized joints. The term can be generalized so that it refers also to other 
mechanical devices, utilized by a handicapped person to compensate for a missing or 
defective limb or part of a limb, in order to replace at least parts of the missing limb's 
function. Examples of these are active or actively lockable orthoses, wheelchairs and other 

10 assistive devices. Furthermore, the term "prosthesis" can refer to all controllable technical 
systems utilized by handicapped and/or healthy persons, such as robots for telemanipulation, 
miniature manipulators for endoscopic operations, as well as machinery, tools and vehicles in 
general; program systems, computers and the like. 
The term "prosthetic state" refers to a mechanical or geometrical state in the prosthesis, 

15 such as an angular or linear position, angular or linear velocity, torque/force, etc., or a 
combination of such figures. 

In the following, the term "muscle" refers to a muscle in the physiological sense, as well as 
to other tissue and/or bones/joints, which can be deformed or moved under direct or indirect 
control by the person's central nervous system, or a combination of these. "Muscle contrac- 

20 tion" refers to the resulting mechanical or geometrical changes in a muscle. The term "motor 
intention" refers to the specific function that the user of the present invention desires to 
activate. In the case of a prosthesis in the usual sense, "motor intention" refers to the motor 
movement or movement pattern that the user wants the prosthesis to perform. 
Prosthesis control based on myoelectric signals is known. One example of this can be 

25 found in EP patent publication 0 421 780. US patent publication 4 571 750 shows 

exploitation of myoacoustic signals for the same purpose. These known methods use, among 
other things, the amplitude of the detected signal as a basis for controlling the prosthesis. 
Variations in skin moisture as well as electric and acoustic noise from the environment fre- 
quently cause undesired variations in the signal amplitude, and thereby directly influence the 

30 control of the prosthesis. Furthermore, myoelectric and myoacoustic signals measured on 
the skin surface express a weighted sum of the activities of all muscles in the area where the 
detecting transducer is placed, but it is difficult to discern between the contributions of the 
individual muscles. 
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It is therefore an object of the present invention to provide a method for control of pros- 
theses and other assistive devices, which has a greater tolerance with regards to disturbances 
than is the case in previously known solutions, so the person's motor intention can be 
estimated more easily. Moreover, it is an object of the present invention to provide a method 
5 and device for the control of prostheses and the like, which allows for identification of 
muscle contraction in multiple subcutaneous muscles simultaneously, so that the person's 
motor intention can be estimated in greater detail and in a greater number of degrees of 
freedom. 

The object of the invention is achieved by a method decribed by the characterizing part of 
10 Claim 1. Additional characteristics are described in the related dependent claims 

In the following, the invention will be explained in further detail by way of examples of 
embodiments and with reference to the accompanying drawings, where 
Fig. la shows an axial cross section of a body part with a muscle in a contracted state, 
Fig. lb shows an axial cross section of a body part with a muscle in a relaxed state, 
15 Fig. 2 shows a cross section of a body part with different tissue structures, where dotted 
lines illustrate how geometric information can be collected from a number of muscles by use 
of ultrasound measurements in a number of directions, according to the present invention, 

Fig. 3 shows a cross section of a body part with different tissue structures, where external 
transducers are arranged according to the present invention, 
20 Fig. 4 shows a cross section of a body part with different tissue structures, where external 
and implanted transducers and reflectors are arranged in accordance with the present inven- 
tion, and 

Fig. 5 shows a principle sketch of an on/off-control system according to the present 
invention. 

25 

Fig. la illustrates a representation of a body part 1 with a skin surface 2, a bone 3 and a 
muscle 4. The muscle 4 is shown in a contracted (shortened) state, and the distance from the 
skin surface 2 to the bone 3 is denoted A,. Fig. lb shows the body part 1 with the muscle 4 
in a relaxed state, with the distance from the skin surface 2 to the bone 3 denoted A b . The 
30 muscle's 4 geometry is seen to change upon contraction, so that the distance A, from the 
skin surface 2 to the bone 3 during muscle contraction is greater than the distance A b during 
muscle relaxation. The degree of muscle contraction in the case illustrated in Fig. la is given 
by the equation (A,-A b ). 
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According to the invention, measurements of the relaxed and contracted states of the 
muscles are made by transmitting an ultrasound pulse into the tissue and then receiving the 
echo from the tissue structures. In fact the different tissue structures are arranged in several 
layers. This is illustrated in Fig. 2. Here, a number of muscles 4 are distributed in the body 
5 part 1 around the bone 3 To measure the state of all muscles 4, it is sufficient to make 
ultrasound shots 5 in a few directions; in the present example ultrasound shots 5 are made in 
four directions in order to observe seven muscles 4. When performing one-dimensional data 
collection (i.e. using only one beam), the only component of the muscle deformation that can 
be observed is that coinciding with the direction of the beam. By performing two-dimen- 

10 sional data collection i.e. in a plane, the muscle deformation components in this plane (two 
dimensions) can be observed. By performing three-dimensional data collection i.e. in a 
volume, the muscle deformation components in all three dimensions can be observed 

The practical implementation of the present invention can be achieved by the use of ultra- 
sound transducers which are in acoustic contact with the skin surface, or alternativeley 

15 implanted into the body. Fig. 3 shows three possible implementations of the invention, where 
a combined transmitting/receiving transducer 6,7 as well as two transmitting transducers 6', 
6" and two receiving transducers 7', 7" are placed on the body part 1, in contact with the skin 
surface 2. Ultrasound pulses 5 are transmitted into the body part 1 by the combined trans- 
mitting/receiving transducer 6,7, and echo from subcutaneous tissue structures are received 

20 by the same transducer 6,7. In Fig 3 only the echo from the bone 3 is illustrated, while echo 
from other tissue structures will also provide information about muscle contractions in the 
relevant region. The transmitting transducer 6' transmits ultrasound pulses towards the bone 
3, and the echo 5' is received by the receiving transducer 7. Between the transducers 6" and 
7", ultrasound pulses 5" are being sent in a straight line from the transmitting to the receiving 

25 transducer. 

Fig. 4 shows three further examples of methods of ultrasound measurements where a 
transducer or a passive reflector is implanted into the body part 1. The combined trans- 
mitting/receiving transducer 6,7 is placed in acoustic contact with the skin surface 2, trans- 
mitting ultrasound pulses 5 into the body part 1. The same transducer 6, 7 then receives the 
30 echo from an implanted reflector 8. The implanted transmitting transducer 6' transmits ultra- 
sound pulses 5' that are being received by the receiving transducer T at the skin surface 2. 
The implanted combined transmitting/receiving transducer 6", 7" transmits ultrasound pulses 
5" and receives echoes from the nearby tissue structures. In Fig. 4, only the echo from the 
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skin surface 2 is illustrated, while echo from other tissue structures will also provide 
information about muscle contractions in the relevant region. 

Different analysis methods can be used for estimating the relevant data from the ultra- 
sound signals received by the receiving transducers 7, 7' and 7". Initially one performs a 
5 global and/or one or more local analyses of the reflected or transmitted signal from muscles 
and other tissue structures. This analysis is then utilized in order to estimate the motor inten- 
tion The analysis can be based on cross correlation between two or more ultrasound 
measurements, the individual measurements being distributed in time. The cross correlation 
analysis can be performed in one, two or three dimensions in order to measure muscle con- 

10 tractions in a corresponding number of dimensions. Alternatively, the analysis can be based 
on "optical flow" analysis, where two ore more temporally distributed ultrasound measure- 
ments are used to estimate the velocity field of the tissue in one, two or three dimensions. 
The estimated velocity field can be integrated to yield estimates of the tissue's rotation, 
translation and deformation in a corresponding number of dimensions. Furthermore, one or 

15 more muscle contractions can be classified and/or quantified by use of pattern recognition 
techniques, using figures calculated by the above mentioned analysis methods as input data 
to a pattern recognition unit. 

The analysis can be based on measurements of tissue translation in one or more depths by 
integrating the phase change of the received signal (velocity measurement). Alternatively, 

20 the analysis can be based on measurement of the "time-of-flight" of the ultrasound pulse 
from the transmitting transducer 6, 6", 6"' to the receiving transducer 7, 7, 7". 

In order to obtain more robust estimates of the user's motor intention, ultrasound 
measurements can be combined with measurements of other observable physiological signals 
and figures e.g. myoelectric signals (EMG) and/or nerve electric signals (ENG). 

25 The method corresponding with the present invention can also be combined with the 
user's interactions with mechanical, electrical and/or electromechanical input apparatus e.g. a 
harness with straps that measure shoulder movement, with switches or force sensors. 

Estimation of muscle contraction can be performed statically or dynamically. Static esti- 
mation uses one or more of the above mentioned methods. Dynamic estimation can be con- 

30 ducted by use of a dynamic state estimator based on a mathematical model of the muscles' 
dynamic behaviour, where estimates from one or more of the above mentioned methods are 
uesd as input signals to the estimator. 
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As already mentioned, the transducers can be placed in a number of different ways. For 
example, they can be mounted in the prosthetic socket in such a way that they are in acoustic 
contact with the skin surface when the prosthesis is fitted on the body part. Gel, a special 
silicone pad or the like might be necessary to ensure good acoustic contact. Furthermore, 
5 the transducers can be mounted in a separate socket e.g. a "bracelet", that can be fitted on 
the body part without any rigid mechanical connection to the prosthetic socket, so that the 
force by which the transducer is pressed against the skin is independent of the forces acting 
between the prosthetic socket and the body part. The transducers can also be implanted into 
the body or have passive ultrasound reflectors implanted into the tissue to use as reference 

10 points in pulse-echo measurements. 

More transducers can be used to obtain redundancy and hence quality improvements, 
allowing for automatic detection and correction of the transducer positions relative to the 
tissue, giving independent control of multiple prosthesis states, etc. An array probe 
consisting of a number of transducer elements can be used to send and measure in multiple 

15 directions or planes by appropriately delaying the signals associated with the individual array 
elements 

Fig. 5 shows the principal structure of a prosthesis control system for on/off control of a 
single prosthetic state. An ultrasound transducer 6, 7, acting both as a transmitter and a re- 
ceiver, is placed on the skin surface 2 of a body part 1, with good acoustic contact, and such 

20 that a muscle 4 is located between the transducer and a bone 3. In this way both the trans- 
mitted ultrasound pulse 5 and the reflected ultrasound pulse 5' pass through the muscle 4. 
The signal from the transducer is fed into a unit 9 that performs signal processing and estim- 
ation. The unit 9 calculates, based on the observed signal, an estimate of the distance be- 
tween the skin surface 2 and the bone 3. A signal from the unit 9 is fed into a unit 10 that 

25 controls the voltage to the prosthesis motor 11, according to the following scheme: 

0V when ( A < A, ) 
u a = ■ U when ( A } < A < A 2 ) 
- U when (A> A 2 ) 

If the prosthesis motor is a permanent magnet DC motor, the final angular velocity of the 
relevant joint function will be proportional to the voltage applied to the motor. The system 
depicted in Fig. 5 thus will make the relevant protshesis joint stop if the muscle 4 is relaxed 
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or only lightly contracted (£<Aj) . A moderate contraction (A,<^<A 2 ) will cause a con- 
stant velocity in one direction, while a strong contraction (A>A 2 ) will cause a constant velo- 
city in the opposite direction. 
The unit 10 can be replaced by a continuous function. Alternatively it can include one or 
5 more feedback paths from prosthesis states, allowing for a more advanced control scheme. 
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Claims: 

1. A device for control of prostheses and other assistive devices, by use of tissue whose 
state is influenced by the central nervous system of a user, comprising at least one transducer 
(6, 7), arranged to sense the state of the tissue, this information being fed into a unit (9, 10) 
that performs signal processing and estimation of the user's motor intention, whereby the 

5 device is arranged to control the prosthesis in correspondence with this estimate, 
characterized in that 

the at least one ultrasound transducer (6, 7) is arranged to send ultrasound signals into the 
tissue, 

the at least one ultrasound transducer (6, 7) is arranged to receive the ultrasound signals 
10 modulated by the tissue, and 

the unit (9, 10) for signal processing and estimation is connected to the at least one 
ultrasound transducer (6, 7), and estimates the user's motor intention based on said received 
ultrasound signals. 

2. The device in accordance with claim 1, 

15 characterized in that one and the same ultrasound transducer (6,7) is arranged for both 
transmission and reception of ultrasound signals 

3 . The device in accordance with claim 1 , 

characterized in that a first ultrasound transducer (6) is arranged for transmission of 
ultrasound signals and that a second ultrasound transducer (7) is arranged for reception of 
20 ultrasound signals. 

4. The device in accordance with any one of the claims 1-3, 

characterized in that the at least one ultrasound transducer (6,7) is arranged for sequen- 
tially transmitting and receiving ultrasound signals with constant or varying time intervals. 

5. The device in accordance with any one of the claims 1-3, 

25 characterized in that the at least one ultrasound transducer (6,7) is arranged for continu- 
ously transmitting and receiving ultrasound signals. 

6. The device in accordance with any one of the claims 1-5, 

characterized in that the at least one ultrasound transducer (6,7) is arranged for transmit- 
ting and receiving ultrasound signals in one or more directions. 
30 7. The device in accordance with any one of the claims 1-5, 
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characterized in that the at least one ultrasound transducer (6,7) is arranged for transmit- 
ting and receiving ultrasound signals in a continous space of two or more dimensions. 

8. The device in accordance with any one of the claims 1-7, 

characterized in that the receiver transducer (7) is arranged for receiving ultrasound 
35 signals that are transmitted from the transmitter transducer (6) via scattering/reflection by 
tissue structures. 

9. The device in accordance with any one of the claims 1-7, 

characterized in that the receiver transducer (7) is arranged for receiving ultrasound 
signals reflected by a number of ultrasound reflectors (8) that are implanted in the body part. 
40 10. The device in accordance with any one of the claims 1-7, 

characterized in that the receiver transducer (7) is arranged for receiving ultrasound 
signals that are transmitted from the transmitter transducer (6) via direct transmission 
through the tissue. 

11. The device in accordance with any one of the claims 1-10, 

45 characterized in that the at least one ultrasound transducer (6, 7) is arranged externally to 
and in good acoustic contact with the body part. 

12. The device in accordance with any one of the claims 1-10, 

characterized in that the at least one ultrasound transducer (6, 7) is implanted in the body 
part 

50 13. The device in accordance with any one of the preceding claims, 

characterized in that the unit (9, 10) for signal processing and estimation is arranged to 
estimate the user's motor intention by cross correlation of a number of temporally separated 
ultrasound measurements or sets of measurements. 

14. The device in accordance with any one of the preceding claims, 

55 characterized in that the unit (9, 1 0) for signal processing and estimation is arranged to 
estimate the user's muscle contractions and motor intention by "optical flow" analysis of a 
number of temporally separated ultrasound measurements or sets of measurements 

15. The device in accordance with any one of the preceding claims, 
characterized in that the unit (9, 10) for signal processing and estimation is arranged to 

60 combine ultrasound measurements with measurements of other observable physiological 
states of signals, such as myoelectric signals (EMG), nerve electric signals (ENG), or the 
user's interactions with mechanical, electric and/or electromechanical input devices. 

16. The device in accordance with any one of the preceding claims, 
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characterized in that the unit (9, 10) for signal processing and estimation is arranged to 
65 estimate the user's muscle contractions and motor intention by use of a pattern recognition 
technique, where the input signals to the pattern recognition unit are generated by use of one 
or more of the techniques described in the preceding claims. 
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Fig. 4 
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Fig. 5 
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